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In a finite-connectivity spin-glass at the zero-temperature limit, long-range correlations exist 
among the unfrozen vertices (whose spin values being non-fixed). Such long-range frustrations 
are partially removed through the first-step replica-symmetry- broken (1RSB) cavity theory, but 
residual long-range frustrations may still persist in this mean-field solution. By way of population 
dynamics, here we perform a perturbation-percolation analysis to calculate the magnitude of long- 
range frustrations in the 1RSB solution of a given spin-glass system. We study two well-studied 
model systems, the minimal vertex-cover problem and the maximal 2-satisfiability problem. This 
work points to a possible way of improving the zero-temperature 1RSB mean-field theory of spin- 
glasses. 
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Spin-glasses are simple models for a large class of dis- 
ordered systems with quenched randomness and frustra- 
tion At low temperatures, ergodicity is broken in 
a spin-glass system, whose configurational phase space 
splits into exponentially many ergodic domains, each of 
which corresponds to a thermodynamic state. Within 
each thermodynamic state, a vertex's spin is partially 
frozen, but the preferred spin orientation and the degree 
of preference are vertex-dependent. Mean- field theories 
for apin-glasses on random graphs of finite connectivity 
0, Hf have attracted a lot of research interest in recent 
years. The work of Mezard and Parisi 0] combines the 
classical Bethe-Peierls approximation (BA) Q with the 
exponential proliferation of thermodynamic states. It is 
a first-step replica-symmetry-broken (1RSB) cavity so- 
lution for finite-connectivity spin-glasses [3|. The zero- 
temperature limit of this mean-field theory [5| has found 
important applications in computer science and informa- 
tion theory @, 0] • 

The essence of the BA is assuming statistical indepen- 
dence among the vertices in the nearest-neighbor set di of 
any given vertex i in the cavity graph where i is removed. 
Very recently, the cavity approximation and loop expan- 
sion method [1, 0, [13, 11 1 were developed, which calcu- 
late the statistical correlations among cavity vertices in 
di. These approaches at the present stage work only in 
the ergodic high-temperature paramagnetic phase. An- 
other theoretical approach of going beyond the BA, which 
works in the spin-glass phase at the other limit of tem- 
perature T — > 13, 13| , is to consider long-range frustra- 
tions among the unfrozen cavity vertices in the set di. At 
the T — > limit, a vertex i of a spin-glass system cither 
takes the same spin value in all the relevant configura- 
tions which contribute to the free energy of the system, 
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or is unfrozen and takes different spin values in differ- 
ent configurations. With respect to a pre-specified value 
a* G ±1, an unfrozen vertex i may be type-I or type-II 
unfrozen, depending on whether or not the fixation of <jj 
to u% — a* leads to the fixation of the spin values of a 
finite fraction of all the other unfrozen vertices 12, 13j |. 
All the type-I unfrozen vertices in a spin-glass system 
are strongly correlated, no matter how far apart they are 
separated from each other. Such strong correlations are 
referred to as long-range frustrations. 

The present work represents a first step in the on- 
going effort of integrating the physical idea of long-range 
frustration into the 1RSB mean-field cavity approach of 
spin-glasses. Long-range frustration is associated with 
crgodicity-breaking: type-I unfrozen vertices are absent 
in the paramagnetic phase. Even in the spin-glass phase, 
long-range frustration should vanish within each ergodic 
subdomain of the configurational space. However, the 
configurational space of a spin-glass system may be or- 
ganized far more complex than what is assumed in the 
1RSB mean-field theory 0]. For example, a macroscopic 
state of the 1RSB solution may actually be a merge of 
several true thermodynamic states (referred to as the sec- 
ond kind or type II instabilities in Ref. 14 1 and Ref. (HI). 
Therefore, it may be possible that type-I unfrozen ver- 
tices still exist within a macroscopic state of the 1RSB 
mean-field solution. Here this possibility is checked by a 
quantitative percolation analysis (by population dynam- 
ics) of spin-flip perturbations. We work on two concrete 
models, the minimal vertex-cover problem (lfl | and the 
maximal 2-satisfiability problem [17} ; we find that resid- 
ual long-range frustrations exist in the former system but 
are absent in the later system. This work suggests a pos- 
sible way of improving the zero-temperature 1RSB mean- 
field theory of spin-glasses. We also discuss possible other 
extensions of the present theoretical framework. The ex- 
istence of residual long-range frustrations is a signature 
of the instability of the T = 1RSB mean-field solu- 
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tion toward further steps of replica-symmetry-breaking 
14, [Til, 18, HH. It is not clear, however, whether the 



onset of long-range frustration is a necessary condition 
for the 1RSB macroscopic state to be non-ergodic (i.e., 
made of smaller sub-states) . 

Percolation analysis. — Type-I unfrozen vertices form a 
giant cluster in a graph, their existence therefore can be 
detected by a percolation analysis. (The propagation of 
correlations among type-I unfrozen variables is close in 
spirit to the notion of bug proliferation of Ref. [2(|.) To 
introduce the basic methodology of percolation analysis 
by population dynamics, let us as an example calculate 
the fraction q of vertices that are in the giant component 
of a random Poissonian graph of mean vertex-degree c 
2l( . We note that a vertex i is in the giant component if 



at least one vertex in its nearest-neighbor set di is in the 
giant component of the cavity graph where i is removed. 
We construct a population of binary elements, each of 
which is either 1 (in the giant component) or (not in 
the giant component). At each elementary update, k ele- 
ments are randomly chosen from the population (k being 
a random integer governed by the Poisson distribution of 
mean c); then a randomly chosen element of the popu- 
lation is set to be if all these k (input) elements are 
zero, otherwise it is set to be 1. The giant component 
size q is estimated to be the fraction of l's in the whole 
population. We found that this value is identical to the 
value predicted by the well-known formula q = 1 — eT cq 
[2lj ]. In what follows we analyze long-range frustrations 
in spin-glasses using this methodology. We demonstrate 
our approach by first working on the minimal vertex- 
cover problem. 

The minimal vertex-cover. — For a given graph Q of N 
vertices and M edges (i, j) between pairs of vertices i and 
j, a minimal vertex-cover is a spin pattern {<7j G ±1} 
which satisfies the constraint 
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and which minimizes the total energy 
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A minimal vertex-cover for a given graph Q is a spin pat- 
tern with the maximal number of uncovered (+1) ver- 
tices, while for each edge of the graph at least one of its 
two end vertices is covered (a = —1). The mean- field 
1RSB cavity solution of the minimal vertex-cover prob- 
lem on finite-connectivity random graphs was reported in 
Ref. [22| . When the mean vertex degree c of the random 
graph satisfies c > 2.7183, the system is in the spin- 
glass phase. In this spin-glass phase, the 1RSB theory 
assumes that in the limit of graph size N — > oo, there are 
exponentially many local optimal vertex-covers for the 



constrained system. Each local optimal pattern is stable 
with respect to any perturbation which flips a finite num- 
ber of spins. A macroscopic state a of the 1RSB mean- 
field solution contains a set of local optimal patterns of 
the same energy E a . Two patterns in the same macro- 
scopic state are assumed to be similar to each other. At 
T = 0, the total grand free energy G of the system can 
be defined by the equation 



cxp(-yG) = ^cxp(-y£ Q ) 
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where the summation is over all the macroscopic states 
of the system; y is a re- weighting parameter [5j, whose 
value is chosen such that G(y) attains maximality (23[. 

A vertex i is referred to as being positively (negatively) 
frozen in macroscopic state a if its spin value is positive 
(negative) in all the configurations of this macroscopic 
state. This spin value freezing is caused by energy min- 
imization under the constraint Eq. (fT]). Vertex i is said 
to be unfrozen in macroscopic state a if it is neither pos- 
itively nor negatively frozen. If in the cavity graph Q\i 
all the vertices in the nearest-neighbor set di of vertex i 
are negatively frozen in state a, then i will be positively 
frozen in macroscopic state a of the full graph Q] on the 
other hand, if two or more vertices in di are positively 
frozen in state a of G\i, then i will be negatively frozen 
in state a of Q. However, the remaining situations are 
tricky. As an example, consider the case in which all 
vertices in the set di are unfrozen in state a of the cav- 
ity graph G\i- When vertex i is added to the system, 
all the vertices in di should take the minus spin value 
so that vertex i will no longer need to be covered. But 
this is possible only when all the unfrozen cavity vertices 
in di are able to take the minus spin value simultane- 
ously. If all these cavity vertices are type-II unfrozen, 
there is no problem. But if two (say j and k) or more 
of these vertices are type-I unfrozen (with respect to the 
minus spin value, of cause) , it may be that flipping aj to 



-1 will force the spin of vertex k to be o~k 



-1! 



This is because when a type-I unfrozen vertex j is fixed 
to o~j — — 1 , eventually a percolating cluster of other un- 
frozen vertices in the whole system will also have their 
spins be fixed (either positively or negatively); all the 
other type-I unfrozen vertices are in this giant cluster 

0. _ 

In the mean-field 1RSB cavity solution [22j all the un- 
frozen vertices are assumed to be type-II, and no long- 
range frustration effect is considered. Here let us assume 
that initially some of the vertices in each macroscopic 
state are type-I unfrozen. We will then check whether 
the fraction of type-I unfrozen vertices will shrink to 
zero in the 1RSB population dynamics. We will focus on 
whether type-I unfrozen vertices persist but not on their 
energetic effects. In other words, we assume that the 
type-I unfrozen cavity vertices in the nearest-neighbor 
set di of each vertex i can take the minus spin simul- 



3 



taneously. Under this simplification, let us consider a 
cavity vertex j which is connected by an edge (i,j) to 
a vertex i of the graph G. In the cavity graph G\i in 
which vertex i is being removed, the cavity vertex j will 
be type-I unfrozen if: (1) only one of the vertices (say k) 
in the set dj\i is positively frozen in the graph G\i,j, and 
(2) this vertex k is itself connected to one or more type-I 
unfrozen vertices of the cavity graph Q\i,j,k [12]. Let 
us denote by 7T°_^ the fraction of macroscopic states in 
which vertex j is positively frozen and none of its nearest- 



neighbors is type-I unfrozen in the cavity graph Q\i,j. 
Similarly, TfjL,, is the fraction of states in which j is pos- 
itively frozen and some of its nearest neighbors is type-I 
unfrozen in G\i,j; is the fraction of states in which 
j is type-II unfrozen in graph Q\i; and nt^i is the frac- 
tion of states in which j is type-I unfrozen in graph Q\i. 
Following the 1RSB cavity approach [22j we can write 
down the following iterative equations for a Poissonian 
random graph: 
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Two steady-state distributions 

P(Kj^i , Kj^i , 7r|^ , tt]^ ) and Pfo ^ , 7r°_j , tt*_^ > ^Uj ) 
on all edges of the graph can be obtained by 

population dynamics simulations [221 ]. An array of 
M = 10 6 vectors = {w^, ff^, tt^, TTjUj is 

constructed; elements of this array are then updated 
according to Eq. ([4]). At given value of the re- weighting 
parameter y t he g rand free-energy density of the system 
is calculated [221 ]. as well as the following long-range 
order parameter Rj^i for each directed edge j — > i: 



Rj^i measures the probability of an unfrozen cavity ver- 
tex j being actually type-I unfrozen. 

For an ensemble of random Poissonian graph with 
mean vertex degree c = 10, the population dynamics 
results are shown in Fig. [T] At y — y* = 3.130(8) the 
grand free-energy density reaches maximum, which cor- 
responds to the ground-state energy density of the sys- 
tem. The mean long-range frustration order-parameter 
R = {l/M)'^2 l Rj^i decreases with the re- weighting pa- 
rameter y and becomes zero for y > 3.25. Most impor- 



tantly, at y — y* the value of R is positive (R = 0.0534). 
Figure [TJ3 shows the distribution of the Rj^i values at 
y = y* . This distribution has a peak at Rj—>i = and 
another peak at Rj—ti ~ 0.043. On average an unfrozen 
vertex is type-I unfrozen in about five percent of the 
macroscopic states. We therefore conclude that in the 
1RSB mean-field treatment of the minimal vertex-cover 
problem there exist still residual long-range frustrations. 
We have also checked that the above qualitative conclu- 
sion holds also for other values the mean vertex degrees 
c > 2.7183. For example, at c = 5, the mean long-range 
frustration order parameter is R = 0.0405, slightly below 
the value for c = 10. 

Does long-range frustration exist in the 1RSB mean- 
field cavity solutions of all finite-connectivity spin-glass 
models with two-body interactions? The following exam- 
ple suggests that this is not necessarily true. 

The maximal 2- satisfiability problem. — On a random 
factor graph [24| Q with N variable nodes i and M — aN 
function nodes a, each of which connects to two randomly 
chosen variable nodes i and j, the 2-SAT energy function 
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FIG. 1: Long-range frustration in the minimal vertex-cover 
problem on an ensemble of random Poissonian graph of mean 
vertex degree c = 10. (A) Grand free energy density (circles) 
and mean long-range frustration R (squares). The vertical 
dotted line indicates the point of y — 3.1297 where the grand 
free energy density is maximal. (B) The distribution of the 
Rj^i values at y = 3.1297. 



is defined as 



E(ai, ...,a N ) = 



(1-4*0(1- jfa) 



(6) 



In Eq. © the quenched coupling constant ,P a of the edge 
between the function node a and variable node i is equal 
to +1 or -1 with equal probability. The Max-2SAT prob- 
lem consists of finding a binary spin pattern which min- 
imizes the configurational energy Eq. ([6]). For a random 
factor graph, it is well known that, the ground-state en- 
ergy of the system is zero when a < 1 jl7j ] ; it becomes 
positive for a > 1, and long-range frustration builds up 
in the Max-2SAT when a > 4.4588 0- 

We have applied the perturbation-percolation analy- 
sis on the 1RSB solution of the Max-2SAT problem de- 
fined on an ensemble of random factor graphs of a = 10. 
As shown in Fig. [21 the grand free-energy density of the 
system reaches maximality at y — 1.932, but the mean 



FIG. 2: Grand free energy density (circles) and mean long- 
range frustration R (squares) for the random 2-SAT problem 
with a = 10. The vertical dotted line indicates the point of 
y = 1.932. 



long-range frustration order parameter R already drops 
to zero at y w 0.75. (For a — 20 similar results are ob- 
tained.) Consequently, the present percolation analysis 
suggests that the 1RSB mean-field solution of the Max- 
2SAT problem is free of any residual long-range frustra- 
tions. Whether or not long-range frustrations persist in 
the mean-field 1RSB solution therefore also depends on 
the particular system under study. 

By passing we note that the 1RSB mean-field theory 
reports a ground-state energy density of 1.307040(2). In- 
terestingly, this value is just located at the middle be- 
tween the predicted lower- and upper-bound of 1.301378 
and 1.311933 [jjjj]. 

Conclusion and discussion. — In summary, in this pa- 
per we have investigated by population dynamics the 
possibility of long-range correlations among the un- 
frozen vertices in the zero-temperature first-step replica- 
symmetry-breaking solutions of finite-connectivity spin- 
glasses. The perturbation-percolation analysis of this 
work demonstrated that, residual long-range frustrations 
may still persist in the mean-field 1RSB cavity solutions. 
The present theoretical approach is also able to give 
a quantitative estimate of the magnitude of long-range 
frustrations in the 1RSB mean-field theory. 

At the present stage we are interested in the existence 
or not of type-I unfrozen vertices in the 1RSB mean-field 
theory, we have not yet actually calculated the energetic 
effects of type-I unfrozen vertices. We hope to return 
to this point in later publications. If the mean long- 
range frustration order parameter is positive, energetic 
effects of long-range frustrations can be included into the 
present population dynamics approach, and a better esti- 
mate of the ground-state energy density can be obtained. 
In the minimal vertex-cover problem, given the fact that 
the mean long-range frustration order parameter R is of 
the order of 10 -2 in the 1RSB solution, the correction to 
the ground-state energy of the system might turn out to 
be very small. 
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The presence of long-range correlations may reflect the 
instability of the 1RSB mean-held solution. Each macro- 
scopic state of the 1RSB solution may be non-ergodic and 
can be further divided into a group of sub-states. A pro- 
cedure of stability analysis for zero-temperature 1RSB 
mean-held solutions has been outlined in Refs. [HQ]!. It 
is of interest to apply this analysis to spin-glass problems 
with two-body interactions and check whether or not its 
qualitative conclusions are consistent with the results ob- 
tained by the long-range frustration analysis. The esti- 
mated mean long-range frustration value R should de- 
pends on the type of ansatz (1RSB, 2RSB,. . . ) used 
for the computation. When a macroscopic state of the 
1RSB solution further breaks into sub-macroscopic states 
(2RSB), a type-I unfrozen vertex in the macroscopic state 
of the 1RSB solution may become frozen in the daughter 
sub-macroscopic states of the 2RSB solution. The mean 
long-range frustration value R therefore will decreases as 
higher steps of RSB are assumed. The present work also 
suggested that, for some spin-glass systems, long-range 
frustrations may be absent in the 1RSB mean-held cav- 
ity solutions. For these systems, maybe the mean-held 
1RSB cavity theory is already enough to describe their 
equilibrium properties at temperature T — > 0. Higher 
levels of replica-symmetry-breaking may not be needed 
any more. However, it is not known whether the exis- 
tence of long-range frustration is a necessary condition 
for the zero-temperature 1RSB mean-held solution to be 
unstable. This point should be checked seriously. 

Both the earlier [13, EH and the present work study 
the statistical mechanical properties of finite-connectivity 
spin-glasses at the limit of zero temperature. When the 
temperature T is low but still positive, long-range cor- 
relations may also exist in mean-held solutions of spin- 
glass systems. However, at hnite temperatures we can 
not make the distinction between frozen and unfrozen 
vertices. This is because all the vertices are unfrozen. 
How to extend the present theoretical approach to the 
case of positive temperatures is an interesting and chal- 
lenging problem. 

JZ and HM are grateful to Prof. Zhong-Can Ou-Yang 
for support. Part of the numerical simulations were per- 
formed at the PC clusters of the State Key Laboratory 
for Scientihc and Engineering Computing, CAS, Beijing. 



^ Electronic address: zhouhj@itp.acxn] 

[1] Fischer, K.H., Hertz, J. A.: Spin Glasses. Cambridge 
Univ. Press, Cambridge (1991) 

[2] Monasson, R.: Optimization problems and replica sym- 
metry breaking in finite connectivity spin glasses. J. 
Phys. A: Math. Gen. 31 (1998) 513-529 



[3. 

K 

[5. 
[6 

ir 

[8 
[9 
[10 

[11 

[12 

[13 

[14 
[15 

[16 

[17; 
[is; 

[19 
[20 

[21 
[22 
[23 

[24 



Mezard, M., Parisi, G.: The bethe lattice spin glass 
revisited. Eur. Phys. J. B 20 (2001) 217-233 
Bethe, H.A.: Statistical theory of superlattices. Proc. R. 
Soc. London A 150 (1935) 552-575 

Mezard, M., Parisi, G.: The cavity method at zero tem- 
perature. J. Stat. Phys. Ill (2003) 1-34 
Mezard, M., Parisi, G., Zecchina, R.: Analytic and algo- 
rithmic solution of random satisfiability problems. Sci- 
ence 297 (2002) 812-815 

Mezard, M., Zecchina, R.: The random k-satisfiability 
problem: from an analytic solution to an efficient algo- 
rithm. Phys. Rev. E 66 (2002) 056126 
Montanari, A., Rizzo, T.: How to compute loop correc- 
tions to bethe approximation. J. Stat. Mech.: Theo. Exp. 

(2005) P10011 

Parisi, G., Slanina, F.: Loop expansion around the bethe- 
peierls approximation for lattice models. J. Stat. Mech.: 
Theo. Exp. (2006) L02003 

Chertkov, M., Chernyak, V.Y.: Loop calculus in statis- 
tical physics and information science. Phys. Rev. E 73 

(2006) 065102(R) 

Chertkov, M., Chernyak, V.Y.: Loop series for discrete 
statistical models on graphs. J. Stat. Mech.: Theor. Exp. 
(2006) P06009 

Zhou, H.: Long-range frustration in a spin-glass model 
of the vertex-cover problem. Phys. Rev. Lett. 94 (2005) 
217203 

Zhou, H.: Long-range frustration in finite connectiv- 
ity spin glasses: a mean-field theory and its application 
to the random ^-satisfiability problem. New J. Phys. 7 
(2005) 123 

Rivoire, O., Biroli, C, Martin, O.C., Mezard, M.: Glass 
models on bethe lattice. Eur. Phys. J. B 37 (2004) 55-78 
Montanari, A., Parisi, G., Ricci-Tersenghi, F.: Insta- 
bility of one-step replica-symmetry-broken phase in sat- 
isfiability problems. J. Phys. A: Math. Gen. 37 (2004) 
2073-2091 

Hartmann, A.K., Weigt, M.: Statistical mechanics of the 
vertex-cover problem. J. Phys. A: Math. Gen. 36 (2003) 
11069-11093 

Fernandez de la Vega, W.: Random 2-sat: results and 

problems. Theor. Comput. Sci. 265 (2001) 131-146 

Montanari, A., Ricci-Tersenghi, F.: On the nature of the 

low-temperature phase in discontinuous mean-field spin 

glasses. Eur. Phys. J. B 33 (2003) 339-346 

Gardner, E.: Spin glasses with p-spin interactions. Nucl. 

Phys. B 257 [FS14] (1985) 747-765 

Mertens, S., Mezard, M., Zecchina, R.: Threshold values 

of random fe-sat from the cavity method. Rand. Struct. 

Algorithms 28 (2006) 340-373 

Bollobas, B.: Random Graphs. Academic Press, Landon 
(1985) 

Weigt, M., Zhou, H.: Message passing for vertex covers. 
Phys. Rev. E 74 (2006) 046110 

Zhou, H.: Boltzmann distribution of free energies in a 
finite-connectivity spin-glass system and the cavity ap- 
proach. Frontiers of Physics in China 2 (2007) 238-250 
Kschischang, F.R., Frey, B.J., Loeliger, H.A.: Factor 
graphs and the sum-product algorithm. IEEE Trans. In- 
fer. Theor. 47 (2001) 498-519 



